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We study the problem of maximizing constrained non-monotone submodular functions and 
provide approximation algorithms that improve existing algorithms in terms of either the ap- 
proximation factor or simplicity. Our algorithms combine existing local search and greedy based 
' algorithms. Different constraints that we study are exact cardinality and multiple knapsack 

constraints. For the multiple-knapsack constraints we achieve a (0.25 — 2e)-factor algorithm. 
^ I We also show, as our main contribution, how to use the continuous greedy process for 

non- monotone functions and, as a result, obtain a 0.13-factor approximation algorithm for 
maximization over any solvable down-monotone polytope. The continuous greedy process has 
been previously used for maximizing smooth monotone submodular function over a down- 
monotone polytope jCCPVOS] . This implies a 0.13-approximation for several discrete problems, 
such as maximizing a non- negative submodular function subject to a matroid constraint and/or 
multiple knapsack constraints. 
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, in several different important problems including cuts in graphs [IFF0HrGW94) . rank functions 

\ of matroids [E70| . and set covering problems |F98| . The problem of maximizing a submodu- 

lar function is NP-hard as it generalizes many important problems such as Max Cut [FG95j . 
Maximum Facility Location |B031 IAS99) , and the Quadratic Cost Partition Problem with non- 
negative edge weights [ GGOS] . 
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1 Introduction 

Submodularity is the discrete analogous of convexity. Submodular set functions naturally arise 



Definition 1. A junction f : 2^ ^ M_|_ is called submodular if and only if\/A,B Q X, f [A) + 
/ {B) > f {An B) + f (AU B). An alternative definition is that the marginal values of items 
should be non-increasing, i.e., \IA,B ^ X , A B X and x € X \ B , fA{x) > fsix), where 



' fA{x) = f{A U {x}) — f{A); fA{x) is called the marginal value of x with respect to A. 

The Submodular Maximization Problem is a pair (/, A) where / is a submodular function 
and A is the search domain. Our aim is to find a set A* € A whose value, f{A*), is maximum. 
Our focus is on non-monotone submodular functions, i.e. we do not require that f{A) < f{B) 
for A<^B<ZX. 

Definition 2. A packing polytope is a polytope P C [0,1]"'^ that is down-monotone: If x,y €z 
[0, 1]"'^ with X < y and y ^ P, then x & P. A polytope P is solvable if we can maximize linear 
functions over P in polynomial time \Dug09^ . 

A packing polytope constraint binds the search domain (A) to a packing polytope. 
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Table 1: Comparison of our results with the existing ones. 



Definition 3. For a ground set X, k weight vectors {w'^}'i=i, and k knapsack capacities {Cj}^^;^ 
are given. A set V C. X is called packable if J2jeV — f^''" ^ = 1, • • • , ^• 

The multiple knapsacks constraint forces us to bind search domain to packable subsets of 
X. In the exact cardinality constraint, we have A = {S': |S'| = A;}. 

Background The problem of maximizing non- monotone submodular functions, with or with- 
out some constraints, has been extensively studied in the literature. In [FMV07] a 0.4-factor 
approximation algorithm was developed for maximizing unconstrained (non-negative, non- 
monotone) submodular functions. The approximation factor was very recently improved to 
0.41 |()V11) . 

For the constrained variants, Lee et al. |LMNS09] . Vondrak [V09j . and Gupta et al. 
[GRSTlO] have provided most outstanding approximation algorithms. In [LMNS09] a 0.2- 
approximation was developed for the problem subject to a constant number of knapsack con- 
straints, followed by a 0.25-approximation for cardinality constraint and a 0.15-approximation 
for the exact cardinality constraint. The latter two approximation factors were later improved 
in |V09j to 0.309, and 0.25, respectively. As a new way of tackling these problems, [GRSTlO] 
provides greedy algorithms that achieve the approximation factor of 0.17 for a knapsack con- 
straint. Greedy algorithms are more common for maximizing monotone submodular functions. 

In a recent work, |V08) and [CCPV08] used the idea of multilinear extension of submodu- 
lar functions and achieved opimal approximation algorithms for the problem of maximizing a 
monotone submodular function subject to a matroid. 

1.1 Our Results 

We consider the problem subject to different constraints. Our results are summarized in Table 
[TJ They are also compared with existing works. We obtain simple algorithms for the exact 
cardinality constraint, multiple knapsack constraints, and a new approximation factor for the 
solvable packing polytope constraint. 

1.2 Preliminaries 

In this section, we introduce the concepts and terms that we often use throughout this paper. 

Multilinear Extension For a submodular function f : 2^ ^ M_|_, the multilinear extension 
of / is defined as follows |(X^PV07j : F: [0, 1]^ ^ M+ and 

F{x) = E[f{x)]=Y.f{S)llx. n (1-^*)- 

sex i&s jex\5 

We use the concept of multilinear extension of a submodular function which is used frequently 
in recent works |(X^PV07[ KX^PVOSl IKST091 ILMNS091 IV09] . 

The multilinear extension of every submodular function is a smooth submodular function 
|CCPV08j . The gradient of F is defined as VF = (^, . . . , ^). 
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Matroid A matroid is a pair M = {X,I) where X C 2^ and 

• yB ei,Ac B ^ Aei. 

• yA,B e I, \A\ < \B\ ^3xe B\A; Au{x} e I. 

Matroid Polytopes A matroid polytope is a solvable packing polytope with special proper- 
ties. Given a matroid A4 = {X,I), we define the matroid polytope as 

P{M) = {x > 0: V5 C X;J2^j ^ ^-m(5)} 

where r_M{S) = max{\I\: / C S*;/ G X} is the rank function of matroid A4. This definition 
shows that the matroid polytope is a packing polytope. 

Randomized Pipage Rounding Given a matroid M = (X, X), the randomized pipage 
rounding converts a fractional point in the matroid polytope, y G P{M) into a random set 
B & I such that E[/(5)] > F(y), where F is the multilinear extension of the submodular 
function /. [(X^FVOTl KX^FVOSl |V09] 

1.3 Recent Developments 

Independently of our work, Kulik et al. have given an (0.25 — e)-approximation algorithm for 
maximizing non-monotone submodular functions subject to multiple knapsacks [KSTll] . Again 
concurrently and independently, Chekuri et al. [CVZllj showed that, by using a fractional local 
search, a 0.325-approximation could be achieved for maximizing non-monotone submodular 
functions subject to any solvable packing polytope. However, the new 0.13-approximation is 
still interesting in that it uses the continuous greedy approach rather than local search, and 
hence it would be more efficient in practice. 

2 Exact Cardinality Constraint 

In this section, we propose very simple algorithm for the exact cardinality constraint problem 
whose approximation factor matches the best existing one, yet it is much simpler and easy to 
implement. Our algorithm is a simple combination of existing local search or greedy based 
algorithms. Our main tool is the following theorem from Gupta et al. [GRSTIO] . 

Lemma 1. flGRSTlO^ }. Given sets C,Si C X, let C = C \ Si, and S2 Q X \ Si. Then 
f{Si U C) + f{Si n C) + f{S2 U C) > f{C). 

Let k be the cardinality number. 

Theorem 1. There is a 0.25-factor approximation algorithm for maximizing a non-monotone 
submodular function subject to an exact cardinality constraint. 

Proof. First, we use the local search algorithm of |LMNS09] and compute a set Si whose size 
is k and 2/(5i) > f{Si U C) + /(Si n C) for any C with \C\ = \Si\ = k. Next, we use the 
greedy algorithm of [GRSTIO] and compute a set ^2 C X\Si of size k such that for any C 
with \C'\ < k, /(S'2) > 0.5/(S'2 U C). Let C be the true optimum and C = C\Si. Therefore, 

2/(Si) + 2/(^2) > f{Si uc) + f{Si nc) + f{S2 u C) > f{C) = OPT 

Thus, the better of Si and S2 gives an approximation factor 0.25. 

Here, we have assumed that k < If not, we can alternatively solve the problem for the 
derived submodular function g{S) = f{X\S) subject to cardinality constraint k' = \X\ — k. □ 

The approximation factor 0.25 matches that of |V09] . though our algorithm is simpler and 
straightforward to implement. 
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3 Multiple Knapsack Constraints 



Lee et al. |LMNS09] propose an 0.2-factor approximation algorithm for the problem. They 
basically divide the elements into two sets of heavy and light objects and then solve the problem 
separately for each set and return the maximum of the two solutions. 

We improve their result by considering both heavy and light elements together. Our algo- 
rithm finds a fractional solution and then integrates it by using randomized pipage rounding. 
In the analysis, we use the negative correlation property of the rounding method stated as the 
following lemma of |CVZ09j . 

Lemma 2. \CVZ09^ Let ai G [0, 1] and X = cnXi where {Xi, . . . , Xn) are obtained by either 
randomized swap rounding or randomized pipage rounding from a starting point (xi, . . . ,Xn) € 
P{M). If6e [0,1], andfi> E[X] = Y.aiXi, then Pr[X > (1 + 5)^] < e~^'^'/^. 

Our algorithm (shown as Algorithm [1] below) is based on the algorithm of Chekuri et al. 
for maximizing monotone submodular functions subject to one matroid and multiple knapsack 
constraints |CVZ09j . We have made some modifications to use it for non-monotone functions. 



Input: Elements' weights {cij}, parameter < e < 1/(4A;^), and a non-monotone 
submodular function / 

D ^ 0. 

foreach subset A of at most 1 /e^ elements do 

0. Set D ^ ^ if f{A) > f{D); 

1. Redefine Cj = 1 — X^ieA 1 < j ^ fc-! 

2. Let B be the set of items i ^ A such that either /yi(«) > e^f{A) or Cij > ke^Cj for 
some j; 

3. Let X* be the fractional solution of the following problem: 

max{G{x) : x G P(>1); yj^CijX, < (1 - e)Cj} (1) 

where A4 is the free matroid over the ground set X' = X \ {AU B), and G{x) is the 
multilinear extension of g{S) = fAiS), S C X' .; 

4. Let R be the result of the randomized pipage rounding applied to x* with respect 
to the matroid polytope P{M). Set D ^ AU R if f{A U R) > f{D); 

end 

Return D. 

Algorithm 1: Non-Monotone Maximization Subject to Multiple Knapsacks 

The following theorem shows how good our algorithm is. 

Theorem 2. Algorithm 1 returns a solution of expected value at least (0.25 — 2e)0PT. 

Proof. The proof follows the line of proofs of [CVZ09j with major changes to adapt it for non- 
monotone case. Let O be the optimal solution, OPT = f{0). Assume \0\ > ^; otherwise, 
our algorithm finds the optimal solution in line 0. Sort the elements of O by their decreasing 
marginal values, and let A C O be the first ^ elements. Consider the iteration in which this set 
A is chosen. Since A has ^ elements, the marginal value of its last element and every element 
not in A is at most e^f{A) < e^OPT. So, throwing away elements whose marginal value is 
bigger than e^/(^) does not hurt. We also throw away the set B C N \ A of items whose 
size in some knapsack is more than ke^Cj. In 0\ A, there can be at most l/{ke^) such items 
for each knapsack, i.e. items in total. Since their marginal values with respect to A are 
bounded by e^OPT, these items together have value g{0 \ B) = fA{0 \ B) < eOPT. The set 
O' = 0\{A\J B) is still a feasible set for the maximization problem, and using submodularity 
its value is: 

g{0') = g{{0 \A)\{0\ B)) > g{0 \ A) - g{0 n B) > OPT - f{A) - eOPT. 
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The indicator vector (1 — e)lo' is a feasible solution for Problem [T] (specified at step 3 of 
Algorithm [T]) . Using the concavity of G{x) along the line from the origin to Iq', we have 
G((l - e)lo') > (1 - e)g{0') > (1 - 2e)0PT - f{A). Using Theorem 4 of |LMNSn9] we can 
compute in polynomial time a fractional solution x* of value: 

G{x*) > ^G{{1 - e)lo') > - 2e)OPT - f{A). 

Finally, we apply randomized pipage rounding to x* and call the resulting set R. By the 
construction of randomized pipage rounding, we have E[(7(i?)] > G{x*). However, R might 
violate some of the knapsack constraints. Consider a fixed knapsack constraint, X^jg^ Cij < Cj. 
Our fractional solution x* satisfies "^Cijx* < (1 — e)Cj. Also, we know that all sizes in the 
reduced instance are bounded by Cij < ke^Cj. By scaling, c'^j = Cij /{ke^Cj), we use Lemma [2] 
with /X = (1 - e)/{ke^): 

PriY^dj > Cj] < Pr[Y,c'ij > (1 + e)fi] < e'^'^'^ < e'^'^^'. 

ieR ieR 

Therefore, Pr[3j : YljeR^v ^ — ke^^^^'^'^. For e < l/(4fc^) this probability is at most 
ke~'^ < 1. Finally, we have a feasible solution of expected value E[/(i?)] = f{A) + E[<^(ii)] > 
f{A) + G{x*)>{l-2e)OPT. □ 

4 Packing Polytope Constraint 

In this section, we adapt the continuous greedy process for non-monotone submodular functions 
and propose an algorithm for solving the optimization problems subject to a packing polytope 
constraint. As an application of the technique, we then consider the problem of submodular 
maximization subject to both one matroid and multiple knapsacks constraints. Finally, we 
briefly show how to replace this continuous process with a polynomial time discrete process 
and suffering only a small error. 

4.1 Continuous greedy process for non- monotone functions 

Similar to [CCPVOS] , the greedy process starts with y(0) = and increases over a unit time 
interval as follows: ^ 

where Vmaxiv) = argmaXy<zp{v.VF{y)). 

When F is non-monotone, we have 

Lemma 3. y(l) G P and F{y{l)) > (1 — e^^)(F{x V y(l)) — F^max), where F is a smooth 
submodular function, x & P, and F^max = niaxo<t<i F{y(l) — y{t)). 

Proof. The proof is essentially similar to that of |CCPV08] with some modifications to adapt 
it for non-monotone functions. First, the trajectory for t S [0, 1] is contained in P since 

y{t) = I Vmax{y{r))dT 

Jo 

is a convex linear combination of vectors in P. To prove the approximation guarantee, fix a 
point y. Consider a direction v* = {x \/ y) — y = (x — y) V 0. This is a non-negative vector; 
since v* < x P and P is down-monotone, we also have v* G P. Consider the ray of direction 
V* starting at y, and the function F(y + (,v*), > 0. The directional derivative of F along this 
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ray is ^ = v* .VF. Since F is smooth submodular (that means, each entry ^ of VF is non- 
increasing with respect to yj) and v* is nonnegative, ^ is non-increasing too and F{y + ^v*) 
is concave in ^. By concavity, we have 

F{y{l) + V*) - F{y{t)) < F{y{t) + v*) - F{y{t)) + F{y{l) - y{t)) < v*.VF{y{t)) + Fdmax- 

Since v* G P and Vmaxiu) G P maximizes v.'VF{y) over all vectors f G P, we get 

w(y).VF(y) > v*.VF{y) > F(y(l) + v*) - Fdmax - F{y). (2) 

We now get back to the continuous process and analyse F{y{t)). Using the chain rule and 
the inequality ([2]), we get 

^ = E = w(y(t)).VF(y(t)) > F{x V y(l)) - Fdmax - F{y{t)). 

Thus, F{y{t)) dominates the solution of the differential equation 

^ = F(x V y(l)) - Fdmax - 4>{t) 

which means (/>(t) = (1 - e-*)(F(x V y{l)) - Fdmax)- Therefore, F{y{t)) > (1 - e-%F{x V 
y{l))- Fdmax)- □ 



4.2 Extending Smooth Local Search. 

As our final tool for obtaining the main algorithm of this section, we propose an algorithm for 
the following problem: Let / be a sumbodular function and F be its multilinear extension. Let 
Mi G [0, 1], 1 < i < n, be a set of upper bound variables and U := < yi < Ui Mi € X}. We 
want to maximize F over the region U: 

max{F(y) : y GlA} 

For this, we extend the 0.4-approximation algorithm (Smooth Local Search or SLS) of 
|FMV07| as follows. We cah our algorithm FMVy- 

We define a discrete set C, of values in [0, 1], where C, = {p-5: 0<p<l/5}, (5 = and p 
is integer. The algorithm returns a vector whose values come from the discrete set Q. We show 
that such a discretization does not substantially harm our solution, yet it reduces the running 
time. 

Let [/ be a multiset containing Si = \_\ui\ copies of each element i G X. We define a set 
function g : 2*^ R+ with ^(r) = F(. . . , . . .), where T C [/ and Ti contains all copies of i in 
T. The function g has been previously introduced in |LMNS09] and proved to be submodular. 
Let B be the solution of running the SLS algorithms for maximizing g and y be its corresponding 
vector. 

Based on |FMV07j . we have g{B) > OAg{A), MA G U; thus 

F{y)>OAF{z), MzeUnC. (3) 
and we can prove the following claim. 

Claim 1. For any x GU, 2.5F(y) > F{x) — where fmax = max{/(i) : i G X}. 

Proof. Let z be the point in nU that minimizes Y17=ii^i ~ ^i)- Claim 3 of |LMNS09] . 
F{z) > F{x) - if^. Using the inequality we get F(y) > 0.4(F(x) - ^^)- This completes 
the proof. □ 
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4.3 The Algorithm 

We now present our algorithm for maximizing a smooth submodular function over a solvable 
packing polytope: 



Input: A packing polytope P and a smooth submodular function F 

1. yi i — The result of running the continuous greedy process. 

2. y[ < — argmaxo<t<iF{yi - y{t)). 

3. yimax < — The result of running FMVy with the upper bound yi. 

4. 7/2 < — The result of running the greedy process over the new polytope P' which is 
built by adding constraints yi < 1 — yi^ for any 1 < z < n to P. Note that P' is a 
down-monotone polytope. 

5. 7/2 < — argmaxo<t<iF{y2 - y{t)). 

6. Return argmax{F{yi), F{y2), F(yimax), FiVi), F{y2))- 



Algorithm 2: Continuous greedy process for non-monotone functions 

Theorem 3. The above algorithm is a i^^g -approximation algorithm for the problem of max- 
imizing a smooth submodular function F over a solvable packing polytope P. 

Proof. Suppose x* € P is the optimum and F{x*) = OPT. By Lemma [3l F[yi) > (1 — 
e-^){F{x* V yi) - F{y[)). We also have F{y2) > (1 - e-^){F{x' V 7/2) - Fiy'^)), where x' = 
X* - {x* A 7/1). Note that x' £ P'. By Claim[Tl we also have F{yimax) > 0.4(F(x* A 7/1) - 
as X* A 7/1 ^7/1. 

By adding up the above inequalities, we get 



_e 

e- 



^(F(7/i) + F{y2)) + Fiy[) + F{y'^) + 2.5F(7/i^,,) 

> F{x* V 7/1) + F{x' V y2) + Fix* A 7/1) - ^ 

> F{x*) - = OPT - 

Therefore the approximation factor of the algorithm is at least -^^^OPT. □ 

Both one matroid and multiple knapsacks As a direct result of the above theorem, we 
propose the first approximation algorithm for maximizing a submodular function subject to 
both one matroid and multiple knapsack. This problem was solved (approximately) in [CVZ09j 
for monotone submodular functions. 

Theorem 4. There exists a approximation algorithm for the problem of maximizing a 

non-monotone submodular function f subject to one matroid and multiple knapsacks. 

Proof. The intersection of the polytopes corresponding to one matroid and multiple knapsacks is 
still a solvable packing polytope. Thus, we can achieve a fractional solution by using Algorithm 
[2] besides the enumeration phase (as in Algorithm [1]) , and then we can round the fractional 
solution into the integral one using randomized pipage rounding. □ 



4.4 Discretizing Continuous Process 

In order to obtain a polynomial time, we discretize the continuous greedy process for non- 
monotone functions and show that by taking small enough time steps, this process only intro- 
duces a small error that is negligible and the solution to the differential inequality does not 
significantly change. 

Let 6 = and C = {p-^- < p < 1/6} be a set of discrete values. We set the unit time 
interval equal to 5 in Algorithm [21 and change lines 2 and 5 of it as follows. 

2 y[ i — argmaxF{yi — 7/(t)), Vt € C 
5 2/2 ^ — argmaxF{y2 - y(t)), Vt G C 



and obtain the following lemma which is weaker (but not very different) than Lemma El 
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Lemma 4. y{l),y[ G P and F{y{l)) > (1 - e-^){F{x V y{l)) - F{y[)) - o{l)OPT, where 
X E P, where P is any solvable packing polytope. 
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